EXTERIOR SPHERE CONDITION AND TIME OPTIMAL 
CONTROL FOR DIFFERENTIAL INCLUSIONS 



PIERMARCO CANNARSA AND KHAI T. NGUYEN 

Abstract. The minimum time function T(-) of smooth control systems is known 
to be locally semiconcave provided Petrov's controllability condition is satisfied. 
Moreover, such a regularity holds up to the boundary of the target under an inner 
ball assumption. We generalize this analysis to differential inclusions, replacing the 
above hypotheses with the continuity of T(-) near the target, and an inner ball 
property for the multifunction associated with the dynamics. In such a weakened 
set-up, we prove that the hypograph of T(-) satisfies, locally, an exterior sphere 
condition. As is well-known, this geometric property ensures most of the regularity 
results that hold for semiconcave functions, without assuming T(-) to be Lipschitz. 

1. Introduction 

This paper is concerned with the time optimal control problem for the differential 
inclusion 




x(t) G F(x(t)) a.e. t > 
x(0) = x G R n , 



with a closed target S C M. n . Here, F : M. n =4 K n is a convex-valued Lipschitz 
continuous multifunction describing the dynamics, and will be subject to further 
conditions in Hamiltonian form (see section [3] below). For each trajectory y x °(-) of 
(11. ip . we denote by 0(y x °(-)) := inf {t > | y xo (t) G S} the transition time from xq 
to S along y x °{-). Clearly, 0(y x °(-)) G [0,oo]. The minimum time T(xq) to reach S 
from xq is defined by 

(1.2) T(x ) : = inf {9(y x °(-)) | y x °(-) is a trajectory of f TTTj) }. 
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Observe that, in general, T(-) : MJ 1 — > [0,oo]. The controllable set C consists of all 
points x G W 1 such that T(x) is finite. 

The regularity of the minimum time function, which is related to the controllability 
of (11. ip . has been the subject of an extensive literature. Most papers study the case 
where F is given with a parameterization, which means that F has the form 

(1.3) F(x) = {f(x, u) \ueU) Vx G W l 

with U C R m compact and / : R n x U -> R n satisfying 

• / is continuous in (x,u), and 

• there exists k > so that 

\f(x ,u) - f(xi,u)\ < k\x - x x \ 

for all u G U and Xq, X\ G M. n . 

On the contrary, fewer results are available for systems modeled by differential in- 
clusions such as (11. ip — an exception to that being [16], where a representation formula 
for the proximal subgradient of T(-) is recovered. Although Lipschitz mult if unctions 
with convex values always admit parameterizations by Lipschitz functions (see [1] and 
[To]), it is a challenging open problem to determine which multifunctions F admit 
parameterizations with smooth functions. Observe that a certain smoothness of the 
parameterization — essentially that /(■, u) be differentiable with D x f(-, u) Lipschitz — 
is crucial in order to derive further regularity properties of the value function, such 
as semiconcavity, by known methods (see [3], and also [B]). This fact explains why 
parameterization theorems have so far proved of little use for regularity purposes. 

Instead of searching for smooth parameterizations, in [8] the first author and Wolen- 
ski proposed an alternative strategy to obtain semiconcavity results for the value func- 
tion of the Mayer problem for system (11.11) . Unlike previous approaches, the proof of 
[8] exploits the semiconvexity in x of the Hamiltonian 

(1.4) H(x,p)= sup (v,p) (i,p)6l n xr, 

veF(x) 

as well as the nonsmooth maximum principle. 

As for time optimal control problems, when F is parameterized as in (I1.3P and 
D x f(-,u) is Lipschitz, the minimum time function is known to be semiconcave on 
C \ int(5) provided S has the inner ball property, and T(-) is dominated by the 
distance from S (see [7], and also [0]). The latter assumption is equivalent to Petrov's 
controllability condition: for some constant \i > and all points x G dS, 

(1.5) min(/(x, it), v) < — [i\v\ 

for all proximal normal vectors v to S at x. This is a strong hypothesis on the control 
system since, when f(x,u) = u, it is equivalent to the fact that U contains an open 



TIME OPTIMAL CONTROL FOR DIFFERENTIAL INCLUSIONS 



3 



neighborhood of the origin. Nevertheless, it is also necessary for the semiconcavity 
of T(-) up to the boundary of the target, because it is equivalent to the Lipschitz 
continuity of T(-) in a neighborhood of S — a direct consequence of semiconcavity. On 
the other hand, the assumption that S satisfies a uniform interior sphere condition^ 
can be removed by the method introduced in [3], where the local semiconcavity of 
T(-) in C \ S is derived from an analogous geometric property of f(x, U). Moreover, 
the approach of [8] to obtain the semiconcavity of the value function, can be adapted 
to the minimum time function for (11. ip . keeping Petrov's condition and the inner ball 
property of S as standing assumptions (see [5]). 

The main purpose of this paper is to study the regularity of T(-) for the general 
system (II .ip . assuming neither the inner ball property of S nor Petrov's condition 
(II. 5p . In view of the above discussion, the expected regularity of T(-) will be weaker 
than semiconcavity, since the Lipschitz continuity of T(-) near S is no longer guar- 
anteed. Similarly, the lack of the inner ball property of S will result in the fact that 
the regularity of T(-) will be just local in C \ S. 

A weaker class of functions enjoying most of the differential properties of semicon- 
cave functions, is the class of all continuous function u whose hypograph is ^-convex, 
see, e.g., [9], [IT]. For any function u of the above class, Colombo and Marigonda ([TT]) 
proved the existence of second order Taylor's expansions a.e., showed the local BV 
regularity of the gradient, and studied the structure of the corresponding singular set. 
For parameterized control systems and targets satisfying an internal sphere condition, 
Colombo and the second author ([12]) obtained yj-convexity results for the hypograph 
of T(-), assuming that T(-) is continuous and the proximal normal cone to the hypo- 
graph of T(-) is pointed at every point. Furthermore, the second author removed the 
pointedness assumption in [T3] proving that, for any function u in the above class, the 
points where the proximal normal cone to the hypograph of u is not pointed form a 
closed set with zero Lebesgue measure. Consequently, in the above ^-convex set-up, 
T(-) retains most of the regularity properties of semiconcave functions. 

Therefore, the main results of our paper can also be described as the extension 
of the analysis of [T2| 113] to systems given in the general form (II. ip . replacing the 
geometric assumption on S with a different property of the dynamics. This goal will 
be achieved in two steps. First, we will show that, if T(-) is continuous, then the 
hypograph of T(-) satisfies an exterior sphere condition provided S has the inner ball 
property (Theorem 14. ip . Then, we shall remove the assumption that S has such a 
property adapting the approach of [I] to system (II. ip . that is, showing that the sub- 
level sets {T(-) < t] acquire the inner ball property for t > small enough, provided 
F(-) satisfies the same geometric property (see Theorem 14. 71 and Corollary !4.8l below). 

1 In this paper, the expressions "5 has the inner ball property" and U S satisfies a uniform interior 
sphere condition" have the same meaning. 
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The outline of this paper is the following. In section El we introduce our notation 
and recall some results from nonsmooth analysis. Our standing assumptions on F and 
H are described in Section [3J, together with basic properties of the Hamiltonian and 
estimates for solutions to certain differential inclusions. Finally, Section H] contains 
our main results and their proofs. 

2. Notation and preliminary results. 

Let Q C lR n be a closed set and let x G Q. We say that a vector v G R n is a 
proximal normal to Q at x (and write v G Nq(x)) if there exists a > such that 

(2.1) (v,y — x) < cr\y — x\ 2 for all y G Q . 

Equivalently, v G Nq(x) if and only if there exists A > such that cIq(x + \v) = X\v\, 
where o?q(-) denotes the distance function from Q. We say that v G Nq(x) is realized 
by a ball of radius p > 0, if (12.11) holds true for a — jp. 
The Clarke normal cone to Q at x, Nq(x), is defined as 

N$(x) = co{£ G R n | 3 Xl x, £ e, & G A^(x 4 )}, 

where co denotes the closed convex hull. 

Now, suppose / : R™ — > (— oo, +oo] is lower semicontinuous and denote by 

epi(/) = {(z, / 8) | /3>/(x)} 

its (closed) epigraph. For any a; G dom(/) := {a; | f(x) < oo}, the set of proximal 
subgradients of / at x, dpf(x), equals 

d P f{x) = {( G M™ | (C-l) G 7V c p pi(/) (a;,/(a;))}. 

Similarly, the set of Clarke subgradients of / at x, df(x), is given by 

df{x) = {£ G R" | (£, -1) G iV c c pi(/) (x, /(x))}. 

The property of semiconcavity has several characterizations (see, e.g., [6]), and we 
now proceed to recall some of them. For a convex set K C M n , a function / : if — >■ R, 
and a constant c > 0, the following properties are equivalent: 

(1) for all xq, x\ G K and < A < 1, one has 

(1 - A)/(x ) + Xf(x 1 ) - f(x x ) < cA(l - A)|xx - x | 2 , 

where X\ — (1 — A)x + Axi, 

(2) / is continuous and, for all x G X and 2 G M n with x ± z £ K, one has 

/(z + z) + /(z-*)-2/(z) <2c|z| 2 , 

(3) the map x 1— > f{x) — c|x| 2 is concave. 
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In any of the above cases, we say that / is (linearly) semiconcave on K with constant 
c, and we call / semiconvex on K if — / is semiconcave. 
The following lemma is proved in [8]. 

Lemma 2.1. Suppose f : W 1 x M. m — > K is Lipschitz in (x, y) on a boxed neighborhood 
U x x U y = {(x, y) | max{|x — x\,\y — y\} < 8} of the point (x, y) G W 1 x M. m , and 
that for each y G U y , the function x — > f(x,y) is semiconvex on U x with constant 
independent of y. Then, for any £ = (£ x ,£ y ) G df(x,y), one has £ x G d x f(x,y). 

We now introduce a concept which plays a major role in the sequel. 

Definition 2.2. Let Q C M n be closed and let O(-) : dQ — > (0, oo) be continuous. We 
say that Q satisfies the 9(-)-exterior sphere condition if and only if, for every x G dQ, 
there exists a nonzero vector v x G Nq(x) which is realized by a ball of radius 9{x). 

Denote by Q' the closure of the complement of Q. We say that the set Q satisfies the 
8 '(•) -interior sphere condition if Q' satisfies the #(-)-exterior sphere condition. If Q 
satisfies the #(-)-interior sphere condition for some constant function $(•) = 0q, then 
we also say that Q has the inner ball property (of radius 9q). 
Finally, for any function / : — > R denote by 

hypo(/) = {(x,/3) | < f(x)} 

the hypograph of /. Let 9 : Q — > (0, oo) be a continuous function. Adapting Defini- 
tion [221 we say hypo(/) satisfies the #(-)-exterior sphere condition if for every igU 
there exists a nonzero vector v x G N^^Jx, f{x)) which is realized by a ball in M n+1 
of radius 9(x). We now recall a result from [13]. 

Proposition 2.3. Let £1 C R N be an open set and let f : f2 — >■ IR be continuous. 
Assume that hypo(f) satisfies the 9(-)-exterior sphere condition, where 9 : Q — > (0, oo) 
is a given continuous function. Then there exists a sequence of sets Qh C Q, with Qh 
compact in dom(/) ; such that: 

(1) the union of Qh covers C N -almost all ofdom(f), 

(2) for all x G Uh^h there exist 5 = S(x) > and L = L(x) > such that f is 
Lipschitz on B(x,5) with constant L, hence semiconcave on B(x,5). 

Consequently, 

(3) f is a.e. Frechet differentiable and admits a second order Taylor expansion 
around a.e. point of its domain. 

3. Hypotheses and some consequences 

We list below our hypotheses on F and H — the problem data introduced in (11.11) 
and (11.41) . repectively — together with some of their consequences. 
Hypotheses (F): 
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(Fl) F(x) is nonempty, convex, and compact for each x G M n . 

(F2) F is Lipschitz continuous with respect to the Hausdorff distance. Thus, if K 

is the Lipschitz constant of F, then K\p\ is the Lipschitz constant of H(-,p), 

i.e., 

(3.1) \H(y,p) - H(x,p)\ < K\p\\y-x\ Vx, y G E" , Vp G M n . 
Hypotheses (H): 

(HI) There exists a constant Co > such that x h> H(x,p) is semiconvex with 

semi convexity constant c |p|. 
(H2) For all p 7^ 0, the gradient V p H(-,p) exists and is globally Lipschitz, i.e., 

(3.2) \V p H(x,p)-V p H(y,p)\ < K x \y - x\ Vx, y G R n , Vp G R" \ {0} , 
for some constant K\ > 0. 

Remark 3.1. In particular, (F2) implies that 

(F3) 3 K 2 > such that max{H | v G F(x)} < K 2 {1 + |x|) , 

which in turn guarantees that solutions to (11.11) are defined on [0, 00). 

Global Lipschitz continuity in both (F2) and (H2) was assumed just to simplify 
computations. Indeed, our results still hold if F is locally Lipschitz with respect to 
the Hausdorff distance, and V p H(-,p) is locally Lipschitz in x, uniformly so over p in 
]R n \{0}. In that case, however, (F3) has to be assumed as an extra condition. 

From Lemma 12.11 we immediately obtain the following. 

Corollary 3.2. Suppose H satisfies assumption (HI). Then 

dH{x,p) C d x H(x,p) x d p H(x,p) Vp ^ . 

The following proposition is a consequence of [8j Proposition 1]. 

Proposition 3.3. Suppose F satisfies (F) and (HI). Then 

(1) for each x,z G W 1 , we have 

H(x + z,p) + H(x — z,p) — 2H(x,p) > — co\p\ \z\ 2 ; and 

(2) for each x,y G W 1 , and £ G d x H(x,p), we have 

H(y,p) - H(x,p) -{£,y-x)> -co|p||y - x\ 2 . 

The differentiability statement in assumption (H2) is equivalent to the argmax set 
of v 1 — y (v,p) being a singleton, which equals V p H(x,p) and will also be denoted by 
F p (x). In view of (H2), for all p 7^ the function F p (-) is globally Lipschitz with 
constant K\. The main use of (H2) is given by the following result whose proof is 
straightforward. 
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Proposition 3.4. Assume (F) and (H), and let p(-) be an absolutely continuous arc 
on [0, T], with p{t) ^ for all t G [0, T] . Then, for each x G M. n , the problem 



(3.3) 



x(t) = F p[t) (x{t)) a.e. t G [0, T] 
x(0) = x 



has a unique solution y(-,x). Moreover, x i— >■ y(t,x) is Lipschitz on M. n and 

(3.4) \y(t,z)-y(t,x)\ < e Klt \z - x\ Vx, z G W 1 , Vt G [0, T] . 

We conclude this section with some simple consequences of Gronwall's lemma. 

Lemma 3.5. Let G : [0, T] x W 1 R n &e an upper semicontinuous multifunction. 
Assume G(t,-) satisfies hypotheses (Fl), (F2) uniformly in t G [0,T], and snc/i 
£/ia£, /or some K > 0, 

M < K Q \p\ G , V(t,p) G [0,T] x R™ . 

Lei p(-) fre a solution of the differential inclusion 



(3.5) 
ITien 



p(t) G G(t,p(t)) a.e. t G [0,T] 
p(0) = po- 



e- Kot \p(0)\ < \p(t)\ < e**|p(0)| VtG[0,T]. 
Moreover, for all < t\ < ti < T, 

e- K ^-^\p{t 2 )\ < < e^^-'^b^)! 

and 

|p(«a)-p(ti)| < Koe^-^ih-hMh)]. 
Proof. Since p(£) = p(0) + j*p{s)ds, we have 

W)\ < W)\ + / \M\ds < \ P (0)\+Ko [ \p(s)\ds. 
Jo Jo 

So, using Gronwall's inequality, we get: \p(t)\ < e Kot \p(0)\. 

We are now going to prove that e~ Kot \p(0)\ < \p(t)\ for all t > 0. Fixing t > 0, we 
define g(s) := p(t — s) for all s G [0,t]. Since g(s) = —p(t — s) for almost s G [0,t], 
we have g(s) = g(0) + g(r)dr for all s G [0,t\. Thus, 



|o(s)| < |o(0)|+/ \g(T)\dr=\g(0)\+ \p(t - r)\dr 
Jo Jo 

< \g(0)\ + K f \p(t - r)\dr = \g(0)\ + K f \g{r)\d 
Jo Jo 
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Again by Gronwall's inequality, we obtain \g(s)\ < e K ° s \g(0)\ for all s G [0,t]. In 
particular, \g(t)\ < e A '°*|<?(0)|. The proof is completed noting that g(t) = p(Q) and 
g(0)=p(t). □ 

Corollary 3.6. Let p(-) be a solution of 113. 5\) . Then either p(t) = for all t G [0,T] 
orp(t) for allt e [0,T\. 

Lemma 3.7. Let y(-,Xo) be a solution of M.l\) . Then, for all t > 0, the following 
holds: 

i) \y(t,x )\ < (|x | + l)e^*-l ; 

%%) \y(t, x ) - x \ < (\x \ + l){e K * - 1) < K 2 (\x \ + l)e K *t. 
Proof. Since 

y{t,x ) = x + y(s,x )ds, 
Jo 

recalling (F3) we have 



\y(s,x )\ds. 



\y(t,x )\ < \x \ + K 2 t + K 2 f 

Jo 

Hence, Gronwall's inequality yields (i). Then, observing that 

\y(t,x ) - x \ < K 2 / (l + \y(s,x )\)ds, 
Jo 

(ii) follows using (i) in the above estimate. □ 

4. Main results 

4.1. Part I. In this part, we will assume that S is nonempty, closed and has the 
inner ball property with balls of radius po > 0. Moreover, assumptions (F) and (H) 
are also assumed throughout. Recall that Cq, K, K\, K 2 are the constants in (HI), 
(F2), (H2), (F3) . Let us define, for any r > 0, 

S'{r) = {x | T(x) > r} , S' = (R n \S) U dS , C = {x e R n \S | T{x) < +00} 
and T\o : O — > R the restriction of T to O, i.e., Tjo(x) = T(x) for x G O. 

Our main results are the following theorem, together with the corollary. 

Theorem 4.1. Assume (F) and (H). Suppose further that S is nonempty, closed and 
has the inner ball property with balls of radius po > an d T(-) is continuous in a 
open subset O of C. Then, the hypograph of Tjo(*) satisfies a pr{')- exterior sphere 
condition for some continuous function pr{-) '■ O — > (0, 00). 



Remark 4.2. The function pr{-) can be explicitly computed and depends only on 
x, T(x), and on c , K, K\, K 2 , p . 
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Consequently, under the assumptions of Theorem 14.11 Tjo(-) enjoys the regularity 
properties described in Proposition [531 Moreover, the following corollary follows from 
Theorem 14. II and [T4"t Theorem 21]. 

Corollary 4.3. Under the assumptions of Theorem \4-l\ ifT(-) is locally Lipschitz in 
O, then T(-) is locally semiconcave in O. 

The main part of the proof of Theorem 14.11 is divided into three lemmas. 

Lemma 4.4. Suppose x G O is not a local maximum ofT(-). Let r = T(x) and let 
x + {-) be an optimal trajectory steering x to S in time r, and set x~(s) = x + (r — s). 
Then, there exists an arc p(-) defined on [0,r], with p(s) ^ for all s G [0,r], such 
that 

-p(s) G d x H(x~(s),-p(s)) a.e. se[0,r], 
x~(s) = — F_p( s )(x _ (s)) a.e. s G [0, r]. 

Moreover, —p(r — t) G Ng,, r _ t Jx + (t)) is realized by a ball of radius p{r — t) for all 
t G [0, r), i.e., 

-p(r — t) -+( \\ ^ 
\p{r-t)V V ~ X {t} ) ~ 2^T-i 

where 



(4.1) 



(4.2) (g^f^--^))< ^h^lv-^ Vyes>(r-t), 



(4.3) P (s) = ^^ e -(K+^)s. 

1 + 2cqPqs 

Proof. Set xi = x + {r). Of course, x\ G dS. Since S satisfies the po-internal sphere 
condition, there exists a proximal normal vector v ^ to S' at X\ such that B(xi + 
Po]f|,Po) Q 5, i.e., 

(4.4) (JL z-xj) < — \z-xA 2 WzeS'. 

\\v\ I 2p 

Now, consider the reversed differential inclusion with initial data 
(4.5) 



y(s) G -F(y(s)) a.e. s G [0,r] 

2/(0) G S^ + po^^o) C5. 

The Hamiltonian associated with — F is defined by 



(4.6) H (x,p) := sup (v,p) = sup (w, —p) = H(x, —p). 

Let us recall that the attainable set from B(xi + , p), denoted A~(r), is defined to 
be the set of all points y(r) where y(-) is a trajectory satisfying (I4.5p . Since x~(-) is 
a solution of (14. 5p with initial point y(0) = x±, and T(-) has not a local maximum at 
the point x, one has that x~{r) = x is on the boundary of A~{r). Indeed, suppose x 
is not on the boundary of A~(r), then there exists e > such that B(x, e) C A~{r). 
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Thus, T(y) < r = T{x) for all y G B(x,e), and we get a contradiction since T(-) 
has not a local maximum at x. Now, since x is on the boundary of A~(r), by [TUj 
Theorem 3.5.4], there is an arc p(-), such that ||p(-)||oo > 0, satisfying 

(4.7) (-p(s),i~(s)) G dH~(x~(s),p(s)) a.e. s G [0,r], 
and 

(4.8) p(o)eN. ■ , v 

From f !4.7p , ( 14. 6 p and Corollary 13.21 we have 

(4.9) -P(s) G d x H(x~(s),-p(s)) a.e. s e [0,r]. 

Moreover, owing to (13. ip . for all v G d x H(x,p) we have \v\ < K\p\. Therefore, 
applying Lemma [331 to G(s, —p(s)) = d x H(x~(s), —p(s)), we get 

(4.10) e- Ks \p(0)\ < \p(s)\ < e Ks \p(0)\ Vs G [0,r]. 

Since ||p(-)||oo > 0, we have p(s) ^ for all s G [0,r]. Therefore, from (14. 7p and 
Corollary 13.21 we get 

(4.11) x-{s) = -d p H(x~(s),-p(s)) = -F_ p{s) (x-(s)) a.e. s G [0,r]. 

We are now going to prove (I4.2p . Fix t G [0, r] and let y G S'(r—t), i.e., T{y) > r—t. 
Let f/ + (-) be the solution of the Cauchy problem 



(4.12) 



y +(s) = F_p (r _i_ s) (y + (s)) a.e. s G [0,r - t], 
y+(0) = y. 



Note that ?/i := y + (r — t) G 5'. Then, y (s) := y + (r — t — s) satisfies y (r — t) = y 
and 



(4.13) 



V ( s ) = -F-p(s)(y (s)) a.e. s e [0,r - t], 

r(o) = yi- 



From gH]), (r4TT3|l and (ED, we have 

(4.14) \y-(s)-x-(s)\<e Kl{r - t) \y 1 -x l \ VsG[0,r-t]. 
In order to prove (I4.2p . observe that 

(4.15) (-p(r - t) , y~ (r - t) - x~~ (r - £)) 

= (-p(0),|/-(0) - x-(0)) + jT ^- s (-p(s),y-(s) - x-(s))ds. 
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Moreover, 

-^{-p(s),y~(s) -x~(s)) 

= (-P(s),y~(s) - x~(s)} + (-p(s),jj~(s) - x~(s)) 
= (-P(s),y-(s) -x~(s)) + (-p{s),-F_ p{s) (y-(s)) + F_ p{s) (x-{s))) 

= (-p(s),y~(s) - x~(s)} - H(y~(s), -p(s)) + H(x~(s), -p(s)). 
Recalling (14. 9 p and Proposition 13.31 it follows that 

(-K s ),y~{ s )-x~( s ))- H {y~( s ),-P( s ))+ H (x~( s ),-p( s )) < c o \P(s)\ \y~( s )-x~(s)\ 2 . 

Therefore, 

(4.16) ^- s (-p(s),y-(s)-x-(s)) <c \p(s)\ \y~(s) - x~(s)\ 2 . 

Owing to (jUD and the fact that p(0) ^ 0, we have - A = A. Thus, by (JO) and 
the fact that y~\ G S 1 we obtain 

Combining f|4.15j) . f !4.16p . ( 14 . 1 Tj) and noting that x~(Q) = x\, y~(0) =y~\,x~(r — t) = 
x + (t), y~(r — t) = y, we conclude that 

(-P(r-t),y-x+(t))< Pfe-^ + Co ^ t \p(s)\\y-(s)-x-(s)\ 2 ds. 

z Po Jo 

Thus, by (14TTU]) and (|Oijl . 

(r^rV " * +(i) > £ + ^ " '>>"™ ,( '-"i* - * + wi 2 

So, (14. 2 p follows (14. 3p . and the proof is complete. □ 

Lemma 4.5. Suppose x E O is not a local maximum ofT(-). Let r = T(x) and let 
x + (-) be an optimal trajectory steering x to S in time r. If p(-) is the arc in Lemma 
\14\ then H(x, -p(r)) > 0. 

Proof. Fixing t G (0,r], by (14.21) and the fact that x G S'(r — t), we have 
(_p( r _ t ) jS _ 5 +( t )) < _ \p( r -t)\ \x-x + (t)\ 2 . 

Equivalently, 

(-p{r-t),J -F_ p{r _ s) (x + (s))ds^ < 2p ^_ ^ ^ -F_p (r _ s) (x + (s))c^ 

Dividing by i both sides of the above inequality, we get 

-/ ^ fo- F -P(r-8)(x + (s))ds \ 1 |/ t -F^ (T ._, ) (x+(g))c;g| 

' p(r - t} ' i / - 2^~T) lp{r ~ t)l 1 
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As t — > 0, we obtain 

(-p(r),-F. p(r) (x)) <0. 
This implies that H(x, —p{r)) > 0. □ 

Lemma 4.6. Suppose x G O is not a local maximum ofT(-). Let r = T(x) and let 
x + (-) be an optimal trajectory steering x to S in time r. Let p(-) be the arc given by 
Lemma \4-4\ and set A = H(x, —p(r)). Then there exists a positive constant such 
that (— p(r),X) G N^ ypo ^ T ^(x, Tjo(x)) is realized by a ball of radius px, i-c, for all 
y eO and ft < T{y) 

(« 8 ) (M^■ te - ^ '' fl - , ' , )-^ (l^ - ^|2 + l ^ , ' |2, ■ 

Moreover, pT = Pt{%) where pr{-) '■ O — > (0, oo) is a continuous function that can be 
computed explicitly. 

Proof. Let y G O. Two cases may occur: 

(i) T{y) < T(x), 

(ii) T(y)>T(x). 

First case: T(y) =: r\ < r = T(x). Let X\ = x + (r — r{) and write 

(4.19) (-P(r), y-x) = (-p(r),y - x x ) + (-p(r), xi - x). 

Recalling Lemma 14.41 and noting that y G S'(r\), we can estimate the first term in 
the right-hand side of the above identity as follows 

(-p(r),y- x x ) =(-p(n),y- x x ) + (-p(r) + p{r x ),y- x x ) 

< 1 \p(n) | \y-x 1 \ 2 + \p(r) - pin) I \y-xt\. 

2p(n) 

From Lemmas 13.51 and 13.71 we have that 

\p(n)\ < e K ^ r ^\p(r)\ , \p(r) - p(n)\ < Ke K{r ~ ri \r - n) \p{r) \ 

and 

\V — %i\ < \y — x\ + \xi — x\ < \y — x\ + K 2 (\x\ + l)e K2 ^'~ Tl \r — r\). 
Thus, observing that p{r\) > p(r), one can get the estimate 

(4.20) (— p(r),y — X\) < L\(\x\, r)\p(r)\(\y — x\ 2 + \r — r\\ 2 ) 
where 

Ll(|x|,r) = 1 + K l(\*\ + 1 ) 2e2K2r e Kr + + 1)e (K + K 2) r + ^Kr 

2p[r) 
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We rewrite the right-most term of (I4.19P as follows 

(-p(r),xi-x) = (-P( r )if o F_ p{r _ s) (x + (s))ds^ 

rr—ri 

= / (-p(r),F_ p(r _ s) (x + (s)))ds 
Jo 

and observe that 

(-p(r),F_ p(r _ s) (x + (s))) = (-p(r),F_ p{r _ s) (x + (s)) - F_ p{r) (x + (s))) 

+ (-p(r),F_p (r) (x + (s)) - F_ Pir) (x)) + (-p(r),F_ p{r) (x)). 
Moreover, recalling that A = H(x, —p(r)), we have 

(-P(r), F_ p(r) (x)} = H(x, -p(r)) = A, 

(-p(r),F_ p(r) (x + (s))-F_ p{r) (x)) < K \p{r)\ \x + (s) — x\ 

< KK 2 (\x\ + l)e K2r \p(r)\ s 

and 

(-p(r), F_ p{r _ s) (x + (s)) - F_ p{r) (x + (s))) 

= (-p(r),F_ p{r _ s) (x+(s))) -H(x + (s),-p(r)) 
= (-p(r)+p(r - s),F_ p{r _ s) (x + (s))) + H(x + (s), -p(r - a)) - H(x + (s), -p(r)) 
< 2K 2 (\x + (s)\ + 1) \p(r) -p(r - s)\ < 2KK 2 (\x\ + l)e iK2+K)r \p(r)\s. 

Therefore, 

(-p(r),F„p (r _ s) (x + (s))) < \ + L 2 (\x\,r) \p(r)\ s 
where L 2 (\x\,r) = KK 2 (\x\ + l)(2e Ar + l)e K2r . Thus, in view of the above estimates, 

(4.21) {-p{r) lXl -x) < A(r-n) + L ^^ r ^ \p( r )\ \r - n\ 2 . 

Combining ( KWf . (jOOjl and we get 

(-p(r), y -x) + X( n - r) < 2 MM^) + ^(M, r) ^ (| _ _ _ |2 + ^ _ ^ 

From Lemma [4.51 we have that A > 0. Therefore, since r\ < r, we conclude that 
-p(r),X) _ \ 2Li(\x\,r) + L 2 (\x\,r) 2 2 



(4-22) ( |(4( r ); A )| > (v-*,P-r))< 1V ' " ' 2 ^ " ' (ly-^ + l^-rn 

for all /5 < r\. So, if T(y) < T(x), then (I4.18P holds true provided pr is such that 

1 



(4 ' 23) ^~ 2^(1x1, r) + L 2 (|x|,r)' 

Second case: T(y) = r x > r = T(x). 
In view of Lemmas 14.41 and I4.5[ we already know that (I4.18P holds for all /3 < r 
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provided px < p(r). So, we just need to prove (14.181) for r < /3 < r±. Let y + (-) be the 
solution of 



(4.24) 



y(s) G F_ p{r) (y(s)) a.e. s G [0, T\ — (3] 

y(0) = y. 



Set i/i = y + (f3 — r) and compute 

(4.25) {-P(r),y - x) = (-p(r),y - y x ) + (-p(r),f/i - x). 

Since r < j3 < r±, one can see that T(yi) > r. Thus, yi G iS'(r). Then, recalling 
Lemma [4.41 we get 

(-P(r),yi-x) < — \p(r)\ |f/i -x\ 2 . 
2p(r) 

Using Lemma 13 .7} we also have 

\Vi -x\ < |yi -y\ + \y-x\ 

< K 2 (\y\ + l)e K ^- r) \(3-r\ + \y-x\. 

So, 

K 2 (\fj\ 4- I^P^^-r) , i 

(4.26) (-pWm-x)^ 2{m+ I 6 , — |p(r)| {\y-x\ 2 + |/3-rf). 

2p(r) 

On the other hand, recalling (13. 2p we have 

rP-r pP-r 



(-p(r),y-y x ) = (-p( r ), j -F_ p(r) (y + (s))ds^ = J (-p(r),-F_ p(r) (y + (s))^ds 
( - p(r),-F_ pir) (y + (s)) + F_ p{r) (x)^ds + J ^ - p(r), -F_ p[r) (x)^ds 

pfi—r pP—T 

<K\ \p{r)\ \ \y + (s) — x\ds + / —H(x,—p(r))ds 
Jo Jo 



= K x \p{r)\ I \y + {s) - x)\ds + A(r - (3). 
Jo 

Owing to Lemma [3 .7\ for all s G [0, {3 — r] 

\y + (s)-x\ < \y + (s)-y\ + \y - x\ 

< K 2 (\y\ + l)e K ^- r) \(3-r\ + \y-x\. 

Therefore, 

(4.27) {-p{ r ),y-y x ) < \( r -P) + K 2 {\y\ + l)e K ^} \p(r)\ (|j7-x| 2 + |/?- r | 2 ). 
Combining fl4T25|) . fl4T26j) and (Q7|l . we get 

( |(I^A)| ' (^-^/ 5 -^)}<^3(l^-^| 2 + ^--l 2 ) 
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where L 3 = ^^f^ 0+1 + K x [l + K 2 {\y\ + l)e Ka ^~% The dependence of L 3 
on \y\ can be easily disposed of taking 

£4(|z|, r) = Km \^ K2 + l + K,[l + K 2 (\x\ + 2)e K >] + 1. 
Then, the above inequality yields 

(4.28) (tM^T^ > (2/-^/3-r))<L 4 (|x|,r)(| ?/ -a;| 2 + |/?-r| 2 ). 

|(-p(r),A)| 

Recalling f lOS]) and and taking 

(4.29) p T := (max{2Li(|z|,T(z)) + La(|x|,T(x)),2L 4 (|x|,r(x))}) \ 

we obtain (I4.18p . Finally, since T(-) is continuous on O, one can easily see that if we 
set Pt{x) = pt then pr(-) is also continuous on O. The proof is complete. □ 



Proof of Theorem ~^A_ , Let x G O. Let r = T{x) and let x + (-) be an opti- 
mal trajectory steering x to 5 in time r. By the dynamic programming principle, 
T(x + (t)) = r — t for all t G (0,r). This implies that x + (t) is not a local maximum 
of T(-) for all t G (0,r). Therefore, by applying Lemma l4.6[ we obtain that for all 
t > sufficiently small, there exists a unit vector q(t) G iV^ po ( T|o )(:r + (t), Tjo(x + (£))) 
realized by a ball of radius pr(x + (t)) where pr(-) is given by (14.291) . i.e, for all y G O 
and /3 < T(y) 

(4.30) (g(t) , (y-x + (t),(3-T(x + (t))) 



Since g(£) is a unit vector in M n+1 for all t > sufficiently small, there exists a 
sequence {t k } which converges to + such that the sequence {q{tk)} converges to a 
unit vector q in R n+1 . Taking t = and then letting k — > 00 in ( I4.30p . by the 
continuity of T(-) and pr{-) in O, we obtain that for all y G O and f3 < T(y), 

q, {y-x,(3- T(xj) ) < — - x\ 2 + |/3 - T(y) | 2 ) 

where Pt(') is given by (I4.29p . Therefore, q G N^ ypo( ^ T ^(x,T\ (x)) is realized by a 
ball of radius pt{T(x)). The proof is complete. □ 
We conclude this part with an example where Petrov's controllability condition 
does not hold, and the minimum time function T is just continuous. Moreover, mul- 
tifunction F admits no C l parameterization even though F and H satisfy assumptions 
(F) and (H). Therefore, the results in [6j [121 C3] do not apply to this example while 
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our results do. 
Example 1. Set 

' [l,t) t<0 



l(t) = \ (1 - V-t 2 + 2t, t) < t < 1 
(0,t) t>l. 

We set the target S to be the right part of IR 2 \{7} and the differential inclusion to 
be 

(x 1 (t),x 2 (t)) e F(x 1 (t),x 2 (t)) = \(u 1 ,h{x 2 {t))u 2 ) | u u u 2 E [0,1]}, 



where 

h(x 2 ) = < 

I x 2 - 1 if x 2 > f. 

Observe first that 5 has the inner ball property. Observe furthermore that for < 
t < 1, the point z t = (l - V-£ 2 + 2t, t) is on the boundary of S, and 



min (v, v) = —\J—t 2 + It 

v£F{z t ) 



where v is the proximal vector to S. Therefore, since lim i _ >0 + V-t 2 + 2t = 0, one can 
see that Petrov's controllability condition (II. 5p does not hold in a neighborhood of 
(1,0) . Moreover, the minimum time function T equals 

1 — Xi if Xi < 1, x 2 < 



T(xi, x 2 ) = ■{ 1 - a/-x^ + 2x 2 - Xi if xi < 1 - a/-x^ + 2x 2 , < x 2 < 1 
-X\ if X\ < 0, x 2 > 1 . 

So, T is continuous, but is not Lipschitz at points (xi,0) for X\ < 1. 

We next show that F admits no C 1 parameterization. We first recall a criterion 
from [8J p3]: if F admits a C 1 parameterization, then the Hamiltonian H (see ( 11.41) ) 
necessarily has the property 

(4.31) H(x,p) = -H(x,-p) => d x H(x,p) = -d x H(x, -p), 

where 9^ denotes the Clarke partial subgradient in x. In this example, the Hamilton- 
ian H is computed as 



H{(xi,x 2 ), (pi,p 2 )) 



pi<0,p 2 <0, 

Pi Pi>0,p 2 <0, 

h(x 2 )p 2 px <0,p 2 > 0, 

pi + h(x 2 )p 2 p\ >0,p 2 > 0. 
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At the point (x u x 2 ) = (1,1), one has that H((l, 1), (0, -1)) = H((l, 1), (0, 1)) = 0. 
However, 

^#((1,1), (0,-1)) = (0,0) and ^((1,1),(0,1)) = (0,[0,1]). 

Since (I4.3ip is violated at the point (1,1), there is no C 1 parameterization of F. 

Finally, since h is a convex function, one can also prove that F and H satisfies the 
assumptions (F) and (H). Therefore, by applying Theorem 14. 1[ the hypograph of T 
satisfies a /9T(")~ ex t er i° r sphere condition. 

4.2. Part II. In this second part, we will study the attainable set A(T) from for 
the reversed differential inclusion 



(4.32) 



x(t) G -F(x(t)) a.e. 
x{0) = 0. 

For any T > 0, such set is defined by 

A(T) := {y(t) | t G [0,T] and y(-) is a solution of flj^Z) }. 

Let us recall that cq, K and K\ are the constants appearing in (Hi), (13. ip and 
(13. 2p . respectively. 

Theorem 4.7. Assume F satisfies (F) and (H). In addition, suppose that, for some 
R > and all x G M. n , F(x) has the inner ball property of radius R. If T > and 
e -3KT > 2cqRT 2 , then the attainable set A(T) has the inner ball property of radius 

y ' v ' (1 + KT + KiT) 2 

Proof. Let x G 5^4(T) and let x~(-) be a trajectory of (14.321) steering to x in time 
T . By the Pontryagin maximum principle, there exists an arc p(-) defined in [0,T], 
with p(s) 7^ for all s G [0, T], such that 

-p(s) G d x H(x~(s),-p(s)) a.e.se[0,T] 
x~(s) = -F_ p{s) (x-(s)) a.e. s G [0,T]. 

We want to prove that, for r := R(T) (where R(T) is defined in (I4.33P ). 

-P(T) 
\P(T)\ 

Equivalently, 

x - r T(^^- -e) G >4(T) for all 6> G B(0, 1). 
V|p(T)| / 

Let 9 G 5(0, 1). Considering the adjoint equation associated with p(-), that is, 



(4.34) 



(4.35) B {x + r Q T^^- r,T) <Z A(T). 



Ks) = -^0 )1 P(s) a.e. 



(4.36) 



z(T) = - 9 

^ ' \P{T)\ ' 
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one can see that 

(4.37) (t(s),p(s)) = -(p(s),z(s)} for a.e. s G [0,7]. 



This implies that 4-{z(s),p(s)) = for a.e. s G [0,T]. Therefore, (z(s),p(s)) is 
constant for all s G [0,T]. In particular, 

(4.38) (z(s),p(s)) = {z(7),p(7)). 

On the other hand, from (I4.36P we have \z(s)\ < Thus, recalling Lemma I3T51 

we obtain 

(4.39) e- K{t2 - tl} \z(t 2 )\ < \z(t!)\ < e K{t2 - tl) \z(t 2 )\ for all < t x < t 2 < 7. 
Set 

(4.40) y e (s) = x(s) - r sz(s), 

we have yg{7) = x — r 7( ^p^ — 6). Thus, our aim is now to prove that y$(7) G A(7). 
Since y~o(0) = x(0) = 0, we only need to show 

Ve(s) G -F(y e (s)) for a.e. s G [0, 7\. 

Observe that F_p^(yg(s)) G dF(y~g(s)). Since F(yg(s)) is convex and has the inner 
ball property of radius R, we have that p(s) is an inner normal vector to dF(y~g(s)) 
at the point F_ p{s) (y e (s)). Thus, -y e (s) G F(y e (s)) (equivalently, y e {s) G -F(y e (s))) 
if —ye(s) G B(F_p( s )(y~g(s)) + R-j=rh, R). Therefore^ our conclusion will follow from 

(4-41) (|||| , -Us) ~ F- m (y e (s))) > -L \y e (s) + F_ p{s) (y e )(s)\ 2 . 

Equivalently, 

(4-42) ^_^ > ^( fl ) + F HK-) (y tf ( fl ))) > ^ |^( S ) + F_, (S) (^)( S )| 2 . 

We are now going to prove (14.42 p . On account of (14.40 p . we have 

y e {s) = -F_p( s )(x(s)) - r z(s) - r sz(s). 



2 Observe that for all R > and x G R N , y G B(x + Rv, R) <i=> (v, y — x) > jjAy - x\ 2 where 



v G M. N is any unit vector. 
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Thus, 

\P(s)\ 

p(s 



,y e (s) + F_ p{s) (y e (s)) ^ 



\P(s)\ 

[H(y e (s),-p(s)) - H (x(s) , -p(s))] 



\p(s) 



+ T-TX\(P( S )> Z ( S )) + r oSj^;(p{s), z(s)). 
\p{s)\ \p{s)\ 



Recalling (14371) . (SUDD and (OSl) . we conclude that 

S \,y e (s) + F_ p{s) (y e (s)) 



\P(s)[ 

[H(y e (s),-p(s))-H(x(s),-p(s))-(-p(s),y e (s)-^ 



\p(s)\ l ' \p(s)\ 

r) 

: r V|z( S )| 2 + ^^^-^ 2 



\P(T)\/ 


p(T) 


"\p(s)\\\p(T)y 


r o \p( t )\ 


p{T) 


2 \p(s)\ 


W)\ 




2 2 

-c r s 



2 \p(s) 



\z(T)\ 2 - 



Recalling Lemma [3.51 and (I4.39p . we obtain 



(4-43) ( - ^M*) + F. m (y e (s))) > ^(-2 Co r r 2 + e" 3 ^) | | 2 . 

Observe that < r = R(T) = R ^i +K t+kvt) 2 " — ^ Then, 



(4.44) ^_|^,^( S ) + J p__ (s) (^( s ))^ > ^(_2 C0J RT 2 + e-^ J ) 

On the other hand, 

|&(s) + F_p (fl) (y fl (s))| < |F_p (s) (y e (s)) - F_ p{s) (x(s))\ + r \z(s)\ + r s\z(s)\ 

< K 1 r s\z(s) \ + r \z(s) \ + Kr s\z(s)\ 

< r (KxT + KT + l)\z(s)\. 

Thus, 

/ p(s) j_ . . _ , , \ e 3XT — 2c RT 2 . 2 

\" + F -«.)(W(»))) > 2r (K 1 r + A-T+ip |j/e(s) + F ^ )( ^ (5))l ' 

and (I4.42p follows . The proof is complete. □ 



20 



PIERMARCO CANNARSA AND KHAI T. NGUYEN 



Finally, let us denote by A(x, T) the attainable set from x in time T for the dif- 
ferential inclusion in (I4.32p . One can see from Theorem 14.71 that there exists a time 
T > such that for all < T < T , the set A(x, T) has the inner ball property of 
radius R(T) given by f)4.33p . Moreover, for any closed set S C M N , let us set 

A(S,T) = \jA(x,T). 

Corollary 4.8. Suppose that S is nonempty and closed. Under the assumptions in 
Theorem \^.l\ there exists T > such that, for all < T < T , then the set A(S, T) 
has the inner ball property of radius R(T) given by \J^.3S ). 

Applying Theorem 14.11 and the above results to the minimum time function for a 
general target, we obtain the following theorem together with useful corollaries. 

Theorem 4.9. Assume (F), (H) and suppose F(x) has the inner ball property of 
radius R for some R > and all Suppose further that S is nonempty, closed 

and T(-) is continuous in a open subset O ofC. Then, the hypograph ofT\o(-) satisfies 
the pt{-)- exterior sphere condition for some continuous function Pt(') : O — > (0, oo). 

Proof. We define, for any < t < T , 

O* = {xeO\ T{x) > t}, S l = A{S, t), 

and T*(-) is the minimum time function for the differential inclusion (11.11) with the 
target S t . One can see that 

T\x) = T(x) - t for all 16 0'. 

Since S* has the inner ball property of radius R(t) > 0, by applying Theorem 14.11 
to T*(-), we obtain that the hypograph of T* ot (-) satisfies a p^(-)-exterior sphere 
condition for some continuous function p l T {-) : O l — > (0, oo). Hence, the hypograph of 
Tjot(-) satisfies the p^(-)-exterior sphere condition. Observe that, since O tx C O t2 C 
O for < t\ < t 2 < To and Ut e ( 0) T )C )< = O, one can prove that T\q{-) satisfies a 
/>r( - )" ex t er i or sphere condition for some continuous function pr{-) '■ O — > (0, oo). □ 

Corollary 4.10. Under the assumptions of Theorem \4-9j 2]o(") satisfies properties 
(l)-(3) in Proposition ^. 31 

Corollary 4.11. Under the assumptions of Theorem \4-fy ifT(-) is locally Lipschitz 
in O, then T(-) is locally semiconcave in O. 
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